Image special effect device, graphic processor and recording medium

ABSTRACT

An image special effect device includes: a graphic processor and a video processing block; the graphic processor converting coordinates in virtual three-dimensional space into two-dimensional coordinates on a display screen in accordance with a supply of information on the shape of a model in the virtual three-dimensional space, computing texture coordinates of an image that is pasted on the display screen and a reduction rate of the model on the display screen, and outputting information on the texture coordinates and reduction rate from an image data output unit; the video processing block writing input video data YUV into a memory after filtered by using a pre-filter coefficient corresponding to information on the reduction rate supplied from the graphic processor, and reading out the video data from the memory by using the supplied texture coordinates as information of read-address.

CROSS REFERENCES TO RELATED APPLICATIONS

The present invention contains subject manner related to Japanese PatentApplication JP 2005-195221 filed in the Japanese Patent Office on Jul.4, 2005, the entire contents of which being incorporated herein byreference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image special effect device fortransforming video data into an arbitrary shape by texture mapping, andto a graphic processor and the like that are used in the image specialeffect device.

2. Description of the Related Art

An image special effect device (effector) has been known as one ofdevices that constitute a non-linear editing system for broadcast andcommercial use. The image special effect device for broadcast andcommercial use is a device that performs transformation processing suchas expansion, reduction and rotation of video data (moving image data)by a hardware circuit.

As for the image special effect device for broadcast and commercial useof related art, transformable patterns are limited to several kinds inadvance by a manufacturer in order to avoid hardware size being enlargedand cost increase, and therefore the transformation can be performedonly using the limited patterns.

On the other hand, in the field of computer graphics, an imagetransformation method called texture mapping is carried out by using agraphic processor that is a processor exclusively used for imageprocessing at comparatively low cost. The texture mapping is a method inwhich an image (texture) is pasted to a model that is prepared bycombining polygons in virtual three dimensional space.

As is known, a vertex shader for geometric processing and a pixel shaderfor rendering processing are installed in the graphic processor. Lately,a graphic processor in which these shaders are programmable has becomethe mainstream.

In the texture mapping, however, aliasing that is a phenomenon in whichthe edge of texture pasted is seen as jag along pixels of a displayscreen is caused depending on a size of the model on the display screen(this size is reduced correspondingly to a distance from a view point toa model). In a graphic processor, MIPMAP (Multum In Parvo Mapping)method is employed to control this aliasing. In the MIPMAP method,textures obtained by reducing the same image using a plurality ofdiscrete reduction rates (1, ½, ¼, ⅛ . . . ) are stored in a memory inadvance and the texture having a reduction rate close to a reductionrate of a model on the display screen is selected (refer to JapanesePublished Patent Application No. 2002-83316 (paragraph No. 0004), forexample).

SUMMARY OF THE INVENTION

In an image special effect device for broadcast and commercial use ofrelated art, it is difficult for a user to determine a transformationpattern arbitrarily, because transformation patterns are limited, asmentioned above.

Further, if hardware circuits for transforming video data into anarbitrary shape are added to the image special effect device forbroadcast and commercial use, hardware size may be enlarged and cost mayincrease.

On the contrary, in a graphic processor that is used in the field ofcomputer graphics, an image can be transformed into an arbitrary shapeby texture mapping. However, the graphic processor is not suitable forprocessing video data in the broadcast and commercial field because ofthe following reasons.

(1) Degradation of Image Quality by MIPMAP Method

In the MIPMAP method, aliasing may not be controlled sufficiently in thecase in which a reduction rate of a model on a display screen does notcorrespond with a reduction rate of a texture that is prepared inadvance. Because of this, the MIPMAP method does not satisfy the imagequality that may be required in the broadcast and commercial field.

(2) Degradation of Image Quality by Color Space Conversion

The graphic processor is configured to process image data in RGB (Red,Green and Blue) color space. Because of this, in order to performtexture mapping on video data in the YUV (luminance and chrominancedifference) space that is used in the broadcast and commercial field, itis necessary to perform conversion processing of color space (conversionfrom YUV space to RGB space and conversion from RGB space to YUV space)when video data is input to and output from the graphic processor.However, because a range of color capable of being expressed isdifferent between the YUV space and RGB space, there is no guarantee forobtaining the same image as input video after the color space conversionis performed.

(3) Limitation of Resolution of Image Data

The graphic processor can only process the image data of resolution upto 8 bits. Therefore, high quality video data of 10 bits that is themainstream in the broadcast and commercial field may not be processed.

(4) Limitation of Processing Speed

In the case where high-resolution video data is processed in the graphicprocessor, since a period of time to access a memory which stores videodata as a texture becomes long, it becomes difficult to process thevideo data in real time.

The present invention addresses the above-identified, and other problemsassociated with conventional methods and devices.

It is desirable to satisfy image quality and real-time processing thatmay be required in the broadcast and commercial field, and also it isdesirable to transform video data into an arbitrary shape by texturemapping without causing hardware size to be enlarged and cost increase.

According to an embodiment of the present invention, there is providedan image special effect device that includes: a graphic processor inwhich a programmable shader is installed and a video processing blockwhich is configured with hardware circuits. The graphic processor isprogrammed to execute processing of converting coordinates in virtualthree-dimensional space into two-dimensional coordinates on a displayscreen in accordance with a supply of information on the shape of amodel in the virtual three-dimensional space and computing texturecoordinates of an image pasted on the display screen and a reductionrate of the model on the display screen. The graphic processor isprogrammed further to execute processing of outputting information onthe texture coordinates and the reduction rate from an image data outputunit. The video processing block includes: a pre-filter that performsfiltering of input video data by using a pre-filter coefficientcorresponding to information on a reduction rate supplied; a memory towhich the video data filtered by this pre-filter is written; and acontrol circuit that reads out the video data from the memory by usingtexture coordinates supplied as information of read-address. In thisimage special effect device, information on the texture coordinates andinformation on the reduction rate that are output from the graphicprocessor are supplied to the control circuit of the video processingblock and to the pre-filter of the video processing block, respectively.

Further, according to an embodiment of the present invention, there isprovided an image special effect device in which information on texturecoordinates and reduction rate that are computed by the graphicprocessor offline (in the state where the video processing block is awayfrom the processor) is supplied to the video processing block by meansof a recording medium or networks.

Further, according to an embodiment of the present invention, there isprovided a recording medium in which a program, by which the abovegraphic processor works and an existing graphic processor with aprogrammable shader installed works as the above graphic processor, isrecorded.

According to an embodiment of the present invention, among processing oftexture mapping, processing not related to image quality that computesand outputs information on the transformed shape (texture coordinatesand reduction rate) and the like of an image is performed by programmingan existing programmable graphic processor.

In other words, in a typical method using a graphic processor of relatedart, information on texture coordinates and reduction rate is used onlywithin the graphic processor and image data finally transformed isoutput from the graphic processor. However, according to an embodimentof the present invention, it is so programmed that information itself ontexture coordinates and reduction rate is output from an image dataoutput unit of the graphic processor.

A period of time necessary for computation and output processing ofinformation on such texture coordinates and reduction rate is constantregardless of resolution of video data, and so real-time processing canbe performed advantageously.

On the other hand, processing of video data itself (that is processingrelated to image quality) is performed by a video processing blockconfigured with hardware circuits, based on information output from thegraphic processor.

In the video processing block, filtering (reduction) of input video datais performed in accordance with information on a reduction rate suppliedfrom the graphic processor. Then, after written into a memory, the videodata is read out from the memory by using information on texturecoordinates supplied from the graphic processor as a read-address, andthe video data is pasted onto a model on a display screen. Therefore,the filtering corresponding to the reduction rate of a model on thedisplay screen is suitably performed on the video data and then thevideo data is pasted, and so aliasing can be controlled sufficiently.

Further, as described above, by processing the video data using anotherhardware circuit provided separately from the graphic processor, itbecomes possible to directly process image data of YUV space (withoutconverting it into RGB space) and to process high quality video data of10 bits.

Hence, video data can be transformed by the texture mapping whilesatisfying image quality and real-time processing that may be requiredin the broadcast and commercial field.

Further, since information on the transformed shape and the like of animage is computed by using a graphic processor of comparatively lowcost, the video data can be transformed into an arbitrary shape withoutcausing hardware size being enlarged and cost increase.

Furthermore, information computed by the graphic processor offline issupplied to this image special effect device by means of a recordingmedium or networks. Hence, information on the transformed shape and thelike of an image is computed by a graphic processor, for example, in apersonal computer at a place away from the place where this imagespecial effect device is provided, and after that, the video data can bepasted practically based on that information. Therefore, a work flow fortexture mapping can be improved.

According to an embodiment of the present invention, the followingeffectiveness is obtained: video data can be transformed into anarbitrary shape by texture mapping without causing hardware size beingenlarged and cost increase while satisfying image quality and real-timeprocessing that may be required in the broadcast and commercial field.

Further, by supplying information computed by a graphic processoroffline to an image special effect device through a recording medium ornetworks, such effectiveness is obtained that a work flow of texturemapping can be improved.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an example of configuration of animage special effect device according to an embodiment of the presentinvention;

FIG. 2 is a block diagram schematically showing a configuration of agraphic processor in FIG. 1;

FIG. 3 is a diagram showing processing of a graphic processor by using atypical method in the past;

FIG. 4 is a diagram showing processing of the graphic processor in theimage special effect device in FIG. 1;

FIG. 5 is a diagram showing an example of a model on screen coordinatesand texture coordinates of an image that is pasted to the model;

FIG. 6 is a diagram showing an example in which texture coordinates areassigned to bits of R, G and B in the processing in FIG. 4; and

FIG. 7 is a diagram showing a configuration of a video processing blockin FIG. 1.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention are explainedspecifically by using drawings. FIG. 1 is a block diagram showing anexample of a configuration of an image special effect device accordingto an embodiment of the present invention. This image special effectdevice 1 is a device that is used as part of a non-linear editing systemin a television broadcasting station and the like. The image specialeffect device 1 includes: an operational panel 2, CPU 3 (i.e. read outmeans/unit), graphic processor 4, buffer memory 5, video processingblocks 6 of four systems, superimposing circuit 7, small-memory-cardslot 8 (i.e. read out means/unit) and communication interface 9 (i.e.communication means/unit) for network communication. The graphicprocessor 4 is installed in a slot (not shown in the figure) for agraphic processor, which is provided on a surface of a casing of theimage special effect device 1. Each of video processing blocks 6 isconnected to one VTR 51 [51(1) to 51(4)], respectively.

Using application software for 3D (three dimensional) computer graphics,the operational panel 2 prepares a model in virtual 3D space; specifiesvideo data (maximum four systems) that is used as a texture; andperforms settings of various parameters. The parameters include: anattribute of a surface of the model, view point, light source,transparency, resolution of a display screen, texture space, positionalrelationship in the depth direction in the case where video data of twoor more systems are superimposed, and the like.

Based on the operation and the like of the operational panel 2, the CPU3 controls each unit of the image special effect device 1 and each VTR51.

The graphic processor 4 is an existing (commercially available) graphicprocessor in which a programmable shader is installed. However, thisgraphic processor 4 has a characteristic with respect to a content ofprocessing that is programmed.

FIG. 2 is a block diagram schematically showing a configuration of thegraphic processor 4. The graphic processor 4 includes an AGP interface11 for transmitting data to and receiving data from an external CPU, avertex shader 12 that performs geometric processing, a pixel shader 13that performs rendering processing, a memory interface 14, and a displayinterface 15 for outputting image data (R, G and B information of 8 bitseach and information α of 8 bits that expresses degree of transparency).

Before explaining the processing of the graphic processor 4 in thisimage special effect device 1, processing of the graphic processor 4 inthe case where the graphic processor 4 is used in a typical method ofthe past is explained with reference to FIG. 3.

When vertex information on a polygon constituting a prepared model andvarious parameters are supplied from an external CPU, the vertex shader12 converts coordinates in virtual 3D space into 2D (two dimensional)coordinates on a display screen (screen coordinates) (step S1). Then,texture coordinates (X, Y) of an image that is pasted to the model onthe display screen and a reduction rate (s) of the model on the displayscreen are computed for each pixel unit of the display screen (step S2).Further, in the step S2, a lighting coefficient (L) for light-sourceprocessing is also computed for each pixel unit if a light source isset, and information in the depth direction (Z) which indicates apositional relationship of textures in the depth direction is alsocomputed for each pixel unit if the textures of two or more systems aredesignated.

Subsequently, through the memory interface 14, the pixel shader 13 readsout a texture having a reduction rate close to the reduction rate (s)among textures stored in an external memory (DRAM) using the MIPMAPmethod by using coordinates (X, Y) as a read-address (step S3). Then,data on R, G and B of the texture is output from the display interface15 (step S4). Note that, in the step S4, information on transparency (α)is also output from the display interface 15 if transparency is set as aparameter.

On the contrary, FIG. 4 shows the processing of the graphic processor 4in this image special effect device 1.

When a model is prepared and parameters are set by the operation of theoperational panel 2, the CPU 3 supplies vertex information on a polygonthat constitutes the prepared model, parameters that were set and IDthat designates information to be output from the graphic processor 4,to the AGP interface 11 of the graphic processor 4 (see FIG. 2).

Note that, information designated by this ID includes information on thetexture coordinates and information on the reduction rate of the modelon the display screen without fail. Further, this information includes alighting coefficient for light-source processing if a light source isset as a parameter. Furthermore, if a positional relationship in thedepth direction in the case where video data of two or more systems aresuperimposed is set as a parameter, this information includesinformation on depth that indicates the positional relationship.

When these information, parameters and ID are supplied from the CPU 3, avertex shader 12 converts coordinates in virtual 3D space into 2D (twodimensional) coordinates (screen coordinates) (step S11). Then, texturecoordinates (X, Y) of an image pasted to the model on the display screenand a reduction rate (s) of the model on the display screen are computedfor each pixel unit of the display screen (step S12). In addition, inthe step S12, a lighting coefficient (L) for light-source processing isalso computed for each pixel unit if a light source is set, andinformation in the depth direction (Z) which indicates a positionalrelationship in the depth direction of two or more video data is alsocomputed for each pixel unit if the video data of two or more systemsare designated.

The processing up to these steps S11 and S12 is the same as theprocessing up to the steps S1 and S2 in FIG. 3. FIG. 5 is a diagramshowing an example of a model on screen coordinates (on a displayscreen) converted in the step S11 and texture coordinates computed inthe step S12. In this example, an image of the texture coordinates of ashaded portion in texture space is pasted to a display position of awave model 61 on the display screen.

Subsequently, information on the texture coordinates and reduction ratethat are designated by the ID from the CPU 3 is assigned to bits of R,G, B and α (step S13) by the pixel shader 13. In other words,information on the texture coordinates (X, Y) and reduction rate (s)computed by the vertex shader 12 is assigned to these bits without fail.Further, a lighting coefficient (L) and information on depth (Z) arealso assigned to bits of R, G, B and α if the lighting coefficient andinformation on depth are designated by this ID.

Then, this information assigned to bits of R, G, B and a is output fromthe display interface 15 (step S14).

FIG. 6 is a diagram showing an example of the step S13 in which thetexture coordinates (X, Y) are assigned. In this example, the texturecoordinates (X, Y) computed by a floating-point mode of 32 bits areconverted into a fixed-point mode of 18 bits (14 bits for integer, 4bits for decimal), and the 18 bits are separated and assigned tolow-rank 2 bits of R, 8 bits of G and 8 bits of B. The reduction rate(s) (as well as the lighting coefficient (L) and information on depth(Z) if those were computed) is also assigned to the remaining bits of Ror to the bits of α, similarly.

As described above, the graphic processor 4 is programmed to outputinformation on texture coordinates (X, Y), reduction rate (s) and thelike of a pixel unit of the display screen from the display interface15. In addition, if this program is onerously or gratuitouslydistributed as a packaged medium such as CD-ROM or the like, a user canuse a graphic processor that the user already owns as the graphicprocessor 4 in this image special effect device 1.

As shown in FIG. 1, information on texture coordinates (X, Y), reductionrate (s) and the like of a pixel unit, which is output from the graphicprocessor 4, is transmitted to the buffer memory 5.

In the buffer memory 5, values of YUV (luminance and chrominancedifference) signals of 10 bits that represent the brightness and colorsof a background portion (background 62 in FIG. 5, for example) of thedisplay screen have been written into memory areas corresponding to allpixels of the display screen as initialization processing by the CPU 3.Then, information on texture coordinates (X, Y), reduction rate (s) andthe like from the graphic processor 4 is overwritten in this initializedbuffer memory 5. Therefore, values of the YUV signals of initial valuesremain as they are in the memory areas corresponding to the pixels towhich information on texture coordinates (X, Y), reduction rate (s) andthe like was not overwritten (that is, pixels in the background portionon the display screen), among the memory areas in the buffer memory 5.

In addition, information read out from a small memory card by the slot 8and information received by the communication interface 9 throughnetworks can be overwritten in the buffer memory 5.

FIG. 7 is a block diagram showing a configuration of each videoprocessing block 6. The video processing block 6 is configured withhardware circuits, and includes a pre-filter unit 21, texture controller22, texture memory 23, interpolating circuit 24, light-source processingcircuit 25 and sync separation circuit 26. The pre-filter unit 21 isconfigured to have a filter coefficient computational circuit 27, H(horizontal) direction pre-filter 28, HV scan-converter 29 and V(Vertical) direction pre-filter 30.

Video data (YUV (luminance and chrominance difference) signals of 10bits) reproduced by the VTR 51 (shown in FIG. 1) connected to each videoprocessing block 6 is supplied to the pre-filter unit 21 and syncseparation circuit 26. The sync separation circuit 26 separates avertical sync signal (vs) from this video data, and transmits thevertical sync signal (vs) to the CPU 3 in FIG. 1.

In synchronization with this vertical sync signal (vs), the CPU 3 readsout the stored information in the memory areas corresponding to allpixels of the display screen sequentially from the buffer memory 5 foreach frame of the video data.

The CPU 3 reconstructs the texture coordinates (X, Y), reduction rate(s), lighting coefficient (L) and depth information (z) by using a RAMinside the CPU 3, with respect to pixels from which values other thanthe initial values (values of YUV signals in the background) were readout. For example, in the case where the texture coordinates (X, Y) areassigned such that the Y is divided into a low rank 2 bits of R, 8 bitsof G and 8 bits of B, as shown in FIG. 6, the texture coordinates (X, Y)are reconstructed from those bits.

The CPU 3 supplies information on the texture coordinates (X, Y) to thetexture memory controller 22 of each video processing block 6 (see FIG.7); supplies information on the reduction rate (s) to the pre-filterunit 21 of each video processing block 6 (see FIG. 7); supplies thelighting coefficient (L) to the light-source processing circuit 25 ofeach video processing block 6 (see FIG. 7); and supplies the depthinformation (Z) to the superimposing circuit 7.

Further, the CPU 3 supplies the data of initial values, as it is, to thetexture memory controller 22 of each video processing block 6, withrespect to pixels in which the initial values (values of YUV signals inthe background) were read out.

As shown in FIG. 7, in the pre-filter unit 21 of each video processingblock 6, the filter coefficient computational circuit 27 computes afilter coefficient (F) for reducing video data correspondingly to areduction rate (s) from the CPU 3 (see FIG. 1) and supplies the filtercoefficient (F) to the H-direction pre-filter 28 and V-directionpre-filter 30.

The H-direction pre-filter 28 performs filtering (filtering in thehorizontal direction of the screen) of the video data supplied from aVTR 51 (see FIG. 1) using this filter coefficient (F) and transmits theresult to the HV scan converter 29.

After writing video data of one frame into an internal memory, the HVscan-converter 29 reads out from the memory the data of each pixel inthe vertical direction of the screen to scan-convert the video data.Then, the video data scan-converted is transmitted to the V-directionpre-filter 30.

The V-direction pre-filter 30 performs filtering (filtering in thevertical direction of the screen) of this video data using the filtercoefficient (F).

The video data on which filtering was performed by the V-directionpre-filter 30 is transmitted to the texture memory controller 22 fromthe pre-filter unit 21.

After writing this video data into the texture memory 23, the texturememory controller 22 reads out video data of each pixel of the displayscreen from the texture memory 23 by using the texture coordinates (X,Y) from the CPU 3 (see FIG. 1) as the read-address. (When resolution ofdisplay screen and resolution of video data are equal, data on a pixelposition corresponding to the pixel of the display screen is read out.When resolution of display screen is higher than resolution of videodata, data on a plurality of (four or eight) pixel positions in thevicinity of the pixel of the display screen are read out.) Then, thevideo data read out is transmitted to the interpolating circuit 24.

However, among the pixels of the display screen, with respect to thepixels to which data of the initial values (values of YUV signals in thebackground) was supplied from the CPU 3 (see FIG. 1), the texture memorycontroller 22 does not perform the readout from the texture memory 23,and the initial values are transmitted to the interpolation circuit 24without any change.

In the case where data on a plurality of pixel positions is transmittedwith respect to one pixel of the display screen (when resolution ofdisplay screen is higher than resolution of video data, as mentionedabove), the interpolation circuit 24 generates data corresponding to thepixel of the display screen by performing the linear interpolation onthe plurality of data. Then, the data generated is transmitted to thelight-source processing circuit 25. In other cases than that, theinterpolating circuit 24 transmits the data transmitted from the texturememory 23, as it is, to the light-source processing circuit 25.

Among the pixels of the display screen, with respect to pixels to whichthe lighting coefficient (L) was supplied from the CPU 3 (see FIG. 1),the light-source processing (expression of reflected light and shadow)corresponding to this lighting coefficient (L) is performed by thelight-source processing circuit 25 on the video data from theinterpolating circuit 24. With respect to the other pixels than those,the light-source processing circuit 25 outputs the video datatransmitted from the interpolating circuit 24, as it is.

The video data output from the light-source processing circuit 25 ofeach video processing block 6 is supplied to the superimposing circuit7, as shown in FIG. 1. In the case where the depth information (Z) issupplied from the CPU 3 (see FIG. 1), the superimposing circuit 7superimposes the video data of two or more systems (maximum foursystems) provided from each video processing block 6 in accordance withthis depth information (Z). In other cases than that (in other words, inthe case that the video data is supplied only from one video processingblock 6), the superimposing circuit 7 outputs the video data supplied,as it is.

The video data (YUV signals of 10 bits) output from the superimposingcircuit 7 is transmitted to an image recording device, monitor and thelike (not shown in the figure) that are connected to the image specialeffect device 1.

As explained above, by programming the existing programmable graphicprocessor 4, this image special effect device 1 performs processing notrelated to the image quality among the processing of texture mapping.The processing not related to the image quality is the processing thatcomputes and outputs information on the transformed shape and the likeof the image (texture coordinates (X, Y), reduction rate (s), lightingcoefficient (L) and depth information (Z)).

In other words, in a typical method of using a graphic processor ofrelated art, information on the texture coordinates, reduction rate andthe like is used only within the graphic processor, and image datafinally transformed is output from the graphic processor. On thecontrary, in this image special effect device 1, the graphic processor 4is programmed such that information itself on the texture coordinate,reduction rate and the like is output from the display interface 15 ofthe graphic processor 4.

Regardless of resolution of video data, a period of time necessary forthe computation and output processing of information on the texturecoordinates, reduction rate and the like is constant, and so real-timeprocessing can be performed.

On the other hand, the processing of video data itself that is theprocessing relating to the image quality is performed by the videoprocessing block 6 configured with the hardware circuits based on theinformation output from the graphic processor 4. In the video processingblock 6, the filtering (reduction) of the input video data is performedin the pre-filter unit 21 in accordance with information on reductionrate (s) supplied from the graphic processor 4. Then, after written intoa texture memory 23, the video data is read out from the texture memory23 by using information on the texture coordinates (X, Y) supplied fromthe graphic processor 4 as the read-address. (When the lightingcoefficient (L) and the depth information (Z) are also output from thegraphic processor 4, the light-source processing and the superimposingprocessing in the superimposing circuit 7 are performed in accordancewith the above information.) And then, the video data is pasted to amodel on the display screen. Therefore, the video data is pasted afterthe filtering was suitably performed on the video data correspondinglyto the reduction rate of the model on the display screen, and soaliasing can be controlled sufficiently.

Further, as described above, since the video data is processed byanother hardware circuit provided separately from the graphic processor4, it becomes possible to directly process the image data of the YUVspace (without converting it into RGB space) and to process high qualityvideo data of 10 bits.

Accordingly, video data can be transformed by texture mapping whilesatisfying the image quality and real-time processing that may berequired in the broadcast and commercial field.

Further, because information on the transformed shape and the like ofthe image is computed by using the graphic processor 4 of comparativelylow cost, video data can be transformed into an arbitrary shape withoutcausing hardware size being enlarged and cost increase.

Furthermore, using a personal computer with a graphic processor beinginstalled and performing the same program as the graphic processor 4,for example, the texture coordinates (X, Y), reduction rate (s) and thelike are computed offline (in the state in which the image specialeffect device 1 is not provided near). Subsequently, the computedinformation is supplied to the image special effect device 1 through asmall memory card or networks (namely, read out from the small memorycard by a slot 8 to be stored into the buffer memory 5, or received bythe interface 9 to be written into the buffer memory 5), and the videodata can practically be pasted in the video processing block 6 of theimage special effect device 1 based on that information. Therefore, thework flow for the texture mapping can also be improved.

Note that, although four systems of the video processing blocks 6 areprovided in the image special effect device 1 in the above embodiment,needless to say, the number of systems can be arbitrarily selected suchas three systems or fewer, five systems or more and the like.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. A broadcast and commercial image special effect device, comprising: acontroller; a memory unit connected to said controller; a graphicprocessor, connected to said memory unit, in which a programmable shaderis installed; and a video processing block, connected to saidcontroller, configured with hardware circuits for outputting YUV videodata; said graphic processor being programmed to execute processing thatconverts coordinates in virtual three-dimensional space intotwo-dimensional coordinates on a display screen in accordance with asupply of information on a shape of a model in the virtualthree-dimensional space and computes texture coordinates of an imagethat are pasted on the display screen and a reduction rate of the modelon the display screen, and processing that outputs said texturecoordinates (X,Y) as stored in two bits of R data, eight bits of G dataand eight bits of B data and that outputs said reduction rate as storedin remaining bits of the R data from an image data output unit to saidmemory unit; said video processing block including a pre-filter thatperforms filtering of input video data by using a pre-filter coefficientcorresponding to the reduction rate supplied thereto by said controller,a memory to which the video data filtered by said pre-filter is written,a control circuit that reads out the video data from said memory byusing supplied texture coordinates as read-address information; andwherein said texture coordinates output from said graphic processor andstored in said memory unit is supplied to said control circuit of saidvideo processing block from the memory unit by the controller, and saidreduction rate output from said graphic processor and stored in saidmemory unit is supplied to said pre-filter of said video processingblock from the memory unit by the controller.
 2. The image specialeffect device according to claim 1, wherein said graphic processor isprogrammed further to execute processing that computes a coefficient inlight-source processing, and to output said coefficient from said imagedata output unit as well, said video processing block further includes alight-source processing circuit that performs light-source processingcorresponding to the supplied coefficient on the video data read outfrom said memory, and said coefficient output from said graphicprocessor is supplied to said light-source processing circuit of saidvideo processing block.
 3. The image special effect device according toclaim 1, wherein said graphic processor is programmed further to executeprocessing that computes a depth direction in the case where the videodata of two or more systems are superimposed to be displayed, and tooutput said depth direction from said image data output unit as well;two or more systems of said pre-filter, said memory and said controlcircuit are included to process the video data of two or more systems inparallel, and a superimposing circuit is further included by which thevideo data read out from said memory of each system is superimposedcorrespondingly to the depth direction supplied; and said depthdirection output from said graphic processor is supplied to saidsuperimposing circuit.
 4. The image special effect device according toclaim 1,wherein said memory unit stores said texture coordinates andsaid reduction rate output from said image data output unit of saidgraphic processor, wherein said texture coordinates and said reductionrate are read out from said memory unit in synchronization with thevideo data input to said video processing block and are supplied to saidcontrol circuit and said pre-filter of said video processing circuit,respectively.
 5. A broadcast and commercial image special effect devicecomprising: a controller; a memory unit connected to the controller;readout means, connected to the memory unit, for reading out informationfrom a recording medium; and a video processing block, connected to thecontroller, configured with a hardware circuit for outputting YUV videodata; said video processing block including a pre-filter that performsfiltering of input video data by using a pre-filter coefficientcorresponding to a reduction rate that is supplied thereto, a memory towhich the video data filtered by said pre-filter is written, and acontrol circuit that reads out the video data from said memory by usinga texture coordinates (X, Y) supplied thereto as read-addressinformation; and wherein the texture coordinates and the reduction rateare read out from the recording medium by said readout means and storedin the memory unit, the texture coordinates and reduction rate aresupplied to said control circuit and said pre-filter of said videoprocessing block, respectively, from the memory unit by the controller,wherein the texture coordinates (X, Y) being stored in two bits of Rdata, eight bits of G data and eight bits of B data in the memory unitand the reduction rate being stored in remaining bits of the R data inthe memory unit.
 6. The image special effect device according to claim5, wherein said recording medium stores a coefficient in light-sourceprocessing; said video processing block further includes a light-sourceprocessing circuit that performs the light-source processingcorresponding to the supplied coefficient in the light-source processingwith respect to the video data read out from said memory; and thecoefficient in the light-source processing that is read out from therecording medium by said readout means is supplied to said light-sourceprocessing circuit of said video processing block.
 7. The image specialeffect device according to claim 5, wherein said recording medium storesa depth direction in the case where video data of two or more systemsare superimposed to be displayed; two or more systems of saidpre-filter, said memory and said control circuit are included to processthe video data of two or more systems in parallel, and a superimposingcircuit is further included by which the video data read out from saidmemory of each system is superimposed correspondingly to the depthdirection supplied; and said depth information read out from therecording medium by said readout means is supplied to said superimposingcircuit.
 8. A broadcast and commercial image special effect devicecomprising: a controller; a memory unit connected to the controller;communication means, connected to the memory unit, for performingcommunication through networks; and a video processing block, connectedto the controller, configured with a hardware circuit for outputting YUVvideo data; said video processing block including a pre-filter thatperforms filtering of input video data by using a pre-filter coefficientcorresponding to a reduction rate that is supplied thereto, a memory towhich the video data filtered by said pre-filter is written, and acontrol circuit that reads out the video data from said memory by usingtexture coordinates (X, Y) supplied thereto as read-address information;and wherein the texture coordinates and the reduction rate are receivedby said communication means and are stored in the memory unit, thetexture coordinates and the reduction rate are supplied to said controlcircuit and said pre-filter of said video processing block,respectively, from the memory unit by the controller, wherein thetexture coordinates (X, Y) being stored in the memory unit in two bitsof R data, eight bits of G data and eight bits of B data and thereduction rate being stored in the memory unit in remaining bits of theR data.
 9. The image special effect device according to claim 8, whereinsaid video processing block further includes a light-source processingcircuit that performs the light-source processing corresponding to acoefficient in the light-source processing, with respect to the videodata read out from said memory, and the coefficient in said light-sourceprocessing that is received by said communication means is supplied tosaid light-source processing circuit in said video processing block. 10.The image special effect device according to claim 8, furthercomprising: two or more systems of said pre-filter, said memory and saidcontrol circuit, to process the video data of two or more systems inparallel, and a superimposing circuit by which the video data read outfrom said memory of each system is superimposed correspondingly to adepth direction, wherein said depth direction that is received by saidcommunication means is supplied to said superimposing circuit.
 11. Agraphic processor comprising a programmable shader installed, beingprogrammed to execute processing that converts coordinates in virtualthree-dimensional space into two-dimensional coordinates on a displayscreen in accordance with a supply of information on a shape of a modelin the virtual three-dimensional space and computes texture coordinates(X, Y) of an image that is pasted on said display screen and a reductionrate of the model on the display screen; and processing that outputssaid texture coordinates (X, Y) as stored in two bits of R data, eightbits of G data and eight bits of B data and said reduction rate storedin remaining bits of the R data from an image data output unit to amemory unit prior to being accessed and output by a controller to avideo processing block for outputting YUV video data of an image specialeffect device.
 12. A non-transitory computer-readable medium encodedwith a program to cause a graphic processor, comprising a programmableshader, to execute the procedures of: converting coordinates in virtualthree-dimensional space into two-dimensional coordinates on a displayscreen in accordance with a supply of information on a shape of a modelin the virtual three-dimensional space and computing texture coordinates(X, Y) of an image that is pasted on the display screen and a reductionrate of the model on the display screen; and outputting said texturecoordinates (X, Y) as stored in two bits of R data, eight bits of G dataand eight bits of B data and said reduction rate stored in remainingbits of the R data from an image data output unit to a memory unit priorto being accessed and output by a controller to a video processing blockfor outputting YUV video data of an image special effect device.
 13. Abroadcast and commercial image special effect device comprising: acontroller; a memory unit connected to the controller; a readout unit,connected to the memory unit, reading out information from a recordingmedium to the memory unit; and a video processing block, connected tothe controller, configured with a hardware circuit for outputting YUVvideo data; said video processing block including a pre-filter thatperforms filtering of input video data by using a pre-filter coefficientcorresponding to a reduction rate to be supplied thereto, a memory towhich the video data filtered by said pre-filter is written, and acontrol circuit, connected to the pre-filter and the memory, that readsout the video data from said memory by using texture coordinates (X, Y)supplied thereto as read-address information; and wherein the texturecoordinates (X, Y) and the reduction rate, that are read out from therecording medium by said readout unit and stored in the memory unit, aresupplied from the memory unit by the controller to said control circuitand said pre-filter of said video processing block, respectively,wherein the texture coordinates (X, Y) being stored in two bits of Rdata, eight bits of G data and eight bits of B data in the memory unitand the reduction rate being stored in the memory unit in remaining bitsof the R data.
 14. A broadcast and commercial image special effectdevice comprising: a controller; a memory unit connected to thecontroller; a communication unit, connected to the memory unit,performing communication through networks; and a video processing block,connected to the controller, configured with a hardware circuit foroutputting YUV video data; said video processing block including apre-filter that performs filtering of input video data by using apre-filter coefficient corresponding to a reduction rate that issupplied thereto, a memory to which the video data filtered by saidpre-filter is written, and a control circuit, connected to thepre-filter and the memory, that reads out the video data from saidmemory by using texture coordinates (X, Y) supplied thereto asread-address information; and wherein the texture coordinates and thereduction rate, that are received by said communication unit and storedin the memory unit, are supplied from the memory unit by the controllerto said control circuit and said pre-filter of said video processingblock, respectively, wherein the texture coordinates being stored in thememory unit in two bits of R data, eight bits of G data and eight bitsof B data and the reduction rate being stored in the memory unit inremaining bits of the R data.